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Data  Assimilation  Intercomparison  Study 


Planned  at  December  2005  HYCOM  Meeting  (RSMAS) 

Forecast  Model:  HYCOM 

Domain:  Gulf  of  Mexico,  1/25Q  resolution  (~3.5  km) 

Assimilation  Time  Period:  2004  -  2005 
Atmospheric  Forcing:  I9  NOGAPS 

Nesting:  climatological  boundary  conditions  (from  1/1 29  Atlantic) 
River  Inputs:  monthly  river  flow 

HYCOM  Assimilation  Systems 

TOPAZ,  ENKF  (NRL),  MVOI  (NCODA),  ROIF,  SEEK,  Ol  (NCEP) 

Control  Run 

Free  run  model  from  2003  -  2006  forced  by  I9  NOGAPS 


Data  Assimilation  Intercomparison  Study 


Intercomparison  Criteria  -  Forecasting  System 
Skill  of  forecasts  as  compared  to  free  run  model 
Skill  of  nowcasts  as  compared  to  free  run  model 

Performance  measures  of  assimilation  system 
Skill  of  assimilative  lateral  boundary  conditions  for  downscaling 
Prediction  of  non-assimilated  (independent)  observations 
Prediction  Loop  Current  and  Loop  Current  eddy  interactions 

Intercomparison  Criteria  -  Oceanographic  Knowledge 

Water  masses  at  all  depths 
Deep  circulation 
Barotropic  Stream  Functions 

Mass  and  velocity  structure  in  Yucatan  and  Florida  Straits 


NCODA  System  Overview 

Sequential  Incremental  Update  Cycle 


Model  forecast  fields  and  prediction  errors  are  used 
in  the  QC  of  newly  received  ocean  observations 


NCODA  Implementation 
Data  Assimilation  Intercomparison  Study 


Observations 

SST  -  satellite  (AVHRR  GAC),  ship,  fixed  and  drifting  buoy 
Profile  -  Argo  Float,  TESAC,  XBT 
Altimeter  -  Jason,  GFO,  ENVISAT 

Synthetics  -  temperature/salinity  profiles  from  assimilation  of  altimeter 
SSH  data  using  Cooper-Haines  vertical  projection  technique 

Assimilation 

24-hour  update  cycle  -  2  Sep  2003  through  1  June  2006 
No  forecasts  beyond  update  cycle  interval 

Incremental  Analysis  Update  (IAU)  procedure  -  increments  inserted 
over  240  model  time  steps  (first  12  hours  of  forecast) 

Verification  Statistics  -  computed  as  daily  averages  by  depth 

OmA  -  observation  minus  analysis  (residuals) 

OmF  -  observation  minus  24  forecast  (innovations) 

OmM  -  observation  minus  free  run  of  model  (control) 

OmC  -  observation  minus  climatology  (GDEM  v3.0) 
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Residual  Innovation  Free  Run  Climate 
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Surface  Temperature  Validation  -  Jan  to  Jun  2006 


HYCOM  1/25  Gulf  of  Mexico  —  Surface  Temperature 
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Temperature  Validation  -  Mean  Bias 

HYCOM  1/25  Gulf  of  Mexico  —  Temperature  HYCOM  1/25  Gulf  of  Mexico  —  Temperature 
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•  analysis  residuals  biased  slightly  warm  -0.08  QC 

•  24-hr  forecasts  from  assimilation  run  essentially  unbiased  -0.1  9C 

•  free  running  model  biased  very  cold  -1 .0  to  >3.0  QC 

•  observations  (synthetics)  biased  warm  and  cold  relative  to  climatology 
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Temperature  Validation  -  RMS  Error 

HYCOM  1/25  Gulf  of  Mexico  —  Temperature 
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•  residual  errors  very  low  ~0.3  QC 

•  innovations  errors  concentrated  in  thermocline 

•  free  running  model  errors  very  large  -1 .0  to  >4.0  QC 
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Temperature  Validation  -  Jan  to  Jun  2006 


HYCOM  1/25  Gulf  of  Mexico  —  Temperature 
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similar  error  patterns  as  2004  and  2005 
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Salinity  Validation  -  Mean  Bias 


HYCOM  1/25  Gulf  of  Mexico  -  Salinity 
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HYCOM  1/35  Gulf  of  Mexico  -  Salinity 


•  residual  and  innovation  salinities  biased  salty  -0.05  PSU 


•  free  running  model  salinities  biased  salty  at  surface  (-0.05  PSU), 
fresh  at  depth  (-0.2  to  0.3  PSU) 


•  observations  (synthetics)  biased  fresh  relative  to  climatology 
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Salinity  Validation  -  RMS  Error 


HYCOM  1/25  Gulf  of  Mexico  -  Salinity 
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HYCOM  1/35  Gulf  of  Mexico 
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•  24-hr  forecast  RMS  errors  very  low  (~0.1  PSU) 

•  free  running  model  RMS  errors  ~0.2  to  0.4  PSU 
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Salinity  Validation  -  Jan  to  Jun  2006 
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HYCOM  1/35  Gulf  of  Mexico  -  Salinity 
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similar  error  patterns  as  2004  and  2005 


In  Situ  Profile  Locations 
January  2004  through  June  2006 


P  -  Argo  profiling  float  (1 3) 

T  -  TESAC  salinity-temperature-depth  profile  (15) 
X  -  expendable  BathyThermograph  (222) 

250  Total !  28  measured  salinity  ! 


In  Situ  Profile  Temperature  Verification 

Mean  Bias  RMS  Error 


Residual  InnoTatlon  Free  Run  Climate 


•  residuals  unbiased,  magnitude  residual  RMS  errors  similar  to  obs  errors 

•  24-hr  forecast  innovations  biased  cold,  maximum  errors  in  thermocline 

•  model  free  run  biased  very  cold  at  all  depths  (0.5  to  2.2  9C) 


In  Situ  Profile  Salinity  Verification 

Mean  Bias  RMS  Error 


Residual  InnoTatlon  Free  Run  Climate 


•  residuals  biased  fresh,  magnitude  residual  RMS  errors  similar  to  obs  errors 

•  24-hr  forecast  innovations  biased  fresh,  large  errors  near  surface 

•  model  free  run  biased  fresh  in  upper  700  m  water  column,  low  errors  at  depth 


Conclusions  and  Future  Plans 


Conclusions 

•  successive  reduction  in  error  from  assimilation 

model  free  run  »  24-hr  assimilative  forecast  >  analysis  nowcast 

•  no  spurious  time  dependent  model  adjustments  to  data  corrections 

•  model  appears  to  be  biased  cold  (all  depths)  and  fresh  (at  depth) 

•  difficult  for  assimilation  to  correct  systematic  model  errors 

•  conclusion  based  primarily  on  synthetic  profiles  at  depth 

•  need  more  in  situ  observations,  better  sampling  in  space  and  time 

Plans 

•  compute  analysis  performance  measures  from  innovation  and  residual 
time  series 

•  prediction  of  independent  data  -  MEDS,  oil  platform  observations,  etc 

•  examine  oceanographic  aspects  of  assimilative  and  model  free  runs 
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Temperature  Validation  -  RMS  Error 

Expanded  Depth  Ranges 
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•  innovation  errors  in  upper  50  m  show  small  corrections  in  mixed  layer 

•  innovation  and  forecast  error  corrections  in  upper  1200  m  are  restricted 
to  depths  shallower  than  -600  m 
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